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A NOTE ON THE STATIONARY BOOTSTRAP'S VARIANCE 

By Daniel J. Nordman 

Iowa State University 

Because the stationary bootstrap resamples data blocks of ran- 
dom length, this method has been thought to have the largest asymp- 
totic variance among block bootstraps Lahiri [Ann. Statist. 27 (1999) 
386-404]. It is shown here that the variance of the stationary boot- 
strap surprisingly matches that of a block bootstrap based on nonran- 
dom, nonoverlapping blocks. This argument translates the variance 
expansion into the frequency domain and provides a unified way of de- 
termining variances for other block bootstraps. Some previous results 
on the stationary bootstrap, related to asymptotic relative efficiency 
and optimal block size, are also updated. 

1. Introduction. Block bootstrap methods "recreate" an observed time 
series for inference by resampling and concatenating small blocks of data. 
Various block bootstraps exist and differ in their approaches to block resam- 
pling. Lahiri [9] investigated four block bootstrap methods for estimating 
the bias or variance of certain time series statistics based on sample means: 
namely, the moving block bootstrap (MBB) from Kiinsch [8] and Liu and 
Singh [11]; the nonoverlapping block bootstrap (NBB) from Carlstein [3]; 
the circular block bootstrap (CBB) from Politis and Romano [14]; and the 
stationary bootstrap (SB) from Politis and Romano [15]. The main findings 
in Lahiri [9] were that all four bootstrap methods have the same asymptotic 
bias but their asymptotic variances can differ due to the distinct block- 
ing mechanism used in each method. For concreteness, we may consider a 
stationary, weakly dependent time series stretch X±,. . . ,X n £ 1 of size n 
and estimate the variance cr^ = n\ai{X n ) of the sample mean X n with a 
block bootstrap estimator. The resulting bootstrap estimator aj of a\ has 
a variance which behaves like 

(1) Var(<rf)=C — \-o(£/n) as n — > oo, 
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where i is the bootstrap block size used, t~ l + £/n = o(l), and C > is a 
constant that depends on the process spectral density as well as the block 
resampling device. Carlstein [3], Kiinsch [8], Biihlmann and Kiinsch [2] and 
Hall, Horowitz and Jing [7] had previously obtained some similar results 
for the MBB and the NBB. However, much development in Lahiri [9] was 
devoted to the SB in particular, because this method resamples blocks of 
random length and thereby differs from the other block bootstraps above 
using fixed block lengths £. Specifically, the variance expansions in [9] (The- 
orem 3.2) suggest that the constants C in (1) differ across block bootstrap 
estimators so that 

Var((7f CBB ) Var(<r| MBB ) 2 
lim — -r = lim — r = - and 

n ^°°Var(<7^ BB ) "-oo \ax{aj NBB ) 3 

(2) 

Hm Var (^,SB) 2 

n-oo Var(al NBB ) 

We claim however that, contrary to (2), the SB actually has the same 
large sample variance as the NBB method based on nonrandom, nonover- 
lapping blocks (to the first order). For illustration, Figure 1 displays the 
ratio of SB and NBB estimator variances Var(a| SB )/ Var( o~ g j\[ BB ) , approx- 
imated by simulation, with samples from three different AR(1) models. As 
the sample sizes increase, the ratio of variances tends to 1 under each process 
model. This result is quite unexpected because the SB estimator had been 
anticipated to have the largest variance among the block bootstraps due to 
"extra randomness" induced by resampling blocks of random length. 

Additionally, Politis and White [16] raised concerns on past claims re- 
garding the potential size of the SB variance and the asymptotic relative 
efficiency (ARE) of the SB to other block bootstraps. This manuscript cor- 
rects the variance of the SB estimator, and thereby invalidates all prior 
comparisons of ARE involving the SB as well as previous optimal block 
size calculations for SB (cf. [9, 10, 16]). We shall update these results in 
Section 2.2 to follow and modify a proposal of Politis and White [16] for 
accurately estimating optimal SB block sizes. 

In reformulating the variance of the SB estimator, we also provide a new 
proof of this result. To determine the leading component in the SB variance, 
the proof in Lahiri [9] involves conditioning arguments and moment bounds 
for random block sums as well as Hilbert space properties. The approach 
given here transfers the SB variance expansion into the frequency domain 
and uses cumulant expressions for the periodogram [1, 5]. This reduces the 
complexity of the arguments and more readily isolates the main contributor 
to the SB variance. The frequency domain arguments appear to be new and 
also apply for determining variances of other block bootstrap estimators in 
a simple manner. 
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We end this section by briefly mentioning other block bootstrap methods. 
Section 2 describes the SB variance estimator for the sample mean and 
provides its large sample variance. Section 3 gives a general variance result 
for lag-weighted sums of sample covariances, which can be used to determine 
the variances of the SB and other block bootstraps. Section 4 proves this 
result. 

Additional block bootstrap methods include the matched block bootstrap 
due to Carlstein, Do, Hall, Hesterberg and Kiinsch [4] and the tapered block 
bootstrap (TBB) proposed by Paparoditis and Politis [12]. These have sim- 
ilar order variances but smaller biases than the other block bootstraps men- 
tioned here, though the matched block bootstrap requires stronger assump- 
tions on the time process (e.g., Markov) than the TBB for bias reduction. 
See [9, 10] for further references on the block bootstrap and block estimation. 

2. Large sample variance of the stationary bootstrap. 
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Fig. 1. Ratio of SB and NBB variances, Var(<r^ ss )/ Vax(d- eNBB ) , for block £ — n~ 
and sample sizes n from AR(1) models: Xt = 4>Xt-i + Zt, {Zt} i.i.d. standard normals, 
4> — 0,0.3, —0.5 (variances based on 5000 simulations) . See Section 2.1 for these estimators. 
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2.1. Stationary bootstrap estimator. We suppose that the data X\, . . . , X n 
arise from a real- valued strictly stationary process {-X^}, t E Z. For simplic- 
ity, we shall focus the exposition on the bootstrap estimator for the variance 
a 2 = nVar(X n ) of the sample mean X n , but similar results hold for vari- 
ance estimation of "nearly linear" statistics formed by a smooth function of 
sample means; see Remark 1 in Section 2.2. 

The SB of Politis and Romano [15] generates a bootstrap version of the 
observed data X±, . . . ,X n by resampling data blocks of random length. To 
describe the method, denote a data block as B(i, k) = pQ, . . . , Xj+fc_i) for 
i,k>l where the data are periodically extended as Xj = X_ n for i > n. 
Let Ji, . . . , J n be i.i.d. geometric random variables, independent of the data, 
where the event "Ji = k" k>l, has probability pq k ~ l for p = l~ x G (0, 1), 
q= 1—p. For K = min{/c : Y^i=i Ji — n }i ^ • • • i Ik be i.i.d. uniform vari- 
ables on {1, . . . , n}. Then, the SB sample Xf, . . . , X* is given by the first n 
observations in the sequence B(Ii, Ji), . . . ,B(Ik, Jk) an d £ = p~ x represents 
the expected length of a resampled block. Under this resampling, Politis and 
Romano [15] show that the SB sample exhibits stationarity. The SB esti- 
mator of a\ is the variance of SB = nVar*(X*|Xi, . . . , X n ) of the bootstrap 
average X* = n~ l Ya=i x t conditional on the data, which has a closed-form 
expression in this case ([15], Lemma 1) as 

n.-l 

(3) crl SB = f(0) + 2j2qk,nr(k), q k>n = (1 - n - l k)q k + n~ l kq n - k 
k=l 

based on sample covariances f(k) = n _1 J2t=i( x t — X n )(X t +k — X n ). 

For comparison, we recall the NBB variance estimator which resamples 
disjoint blocks of fixed integer length £ > 1 as suggested by Carlstein [3]. 
For this, we randomly sample b = [n/l\ blocks with replacement from the 
nonoverlapping collection {B(£(i — 1) + l,£i) :i = 1, . . . ,6} and concatenate 
these to produce the NBB sample X% NBB , . . . , X£ g NBB of size b£ with sam- 
ple mean X* NBB = (M)' 1 YaLi x *nbb- The NBB variance estimator for 



V£,NBB = bl V al *(. X n,NBB\ X li • ■ ■ i X n) ~ J^{Xi,NBB ~ X n ) 2 , 

i=l 

which is a scaled sample variance of block means X^jvbb = £~ X J2k=£(i-i)+i x k, 
i = l,...,b with X n = b' 1 £)£ =1 Xi^NBB- 

2.2. Variance expression for stationary bootstrap estimator. We state the 
SB variance in Theorem 1, which requires some notation. Denote the co- 
variances and spectral density of {Xt} as r(k) = Cov(Xq,X/ ( .), k £ Z and 
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f(w) = (2vr)- 1 X; fcgZ r(/c)e- lfcw , w£l, i = Let cu(Y u . . . ,Y m ) denote 

the cumulant of arbitrary random variables (Y\, . . . ,Y m ), m > 1. The as- 
sumptions are A.1-A.3 as follows: 

oo 

A.l: |r(0)| + J>|r(fc)|<oo; A.2: £ |cu(A ,A\,Xt 2 , X ts )| < oo; 

fc=l tl,*2,*36Z 

and A. 3: £ — > oo and ^logra/n — > as n —> oo. Assumptions A.1-A.2 essen- 
tially correspond to those of Politis and Romano [15] for showing consistency 
of the SB estimator aj SB . These hold under the mixing-based moment con- 
ditions assumed by Kiinsch [8], Politis and White [16] and Paparoditis and 
Politis [12] for stating variance expansions for MBB/NBB, CBB and TBB 
estimators, respectively, of the sample mean's variance. The SB variance 
result will be derived in Section 3, requiring a slightly stronger block condi- 
tion A.3 than tjn = o(l) introduced by Kiinsch [8] (Theorem 3.3) for MBB 
variance calculations. Lemma 1 of Section 4 describes how A.l is applied. 

For completeness, we include the bias of the SB estimator in Theorem 1, 
originally given by [15], in (9). 

Theorem 1. Under assumptions A.1-A.3 and osn-> oo, the variance 
of the SB estimator o\ SB of cr 2 = n Var(X n ) is 

Var(<x| Si3 ) = ^2{2vr/(0)} 2 + o(£/n). 
Under A.l and l~ l + £ 2 /n = o(l) as n — > oo, the bias of the SB estimator is 

E(&Isb) ~ °l = ~J + oil ft) where G = J2 \ k \ r ( k )- 

The SB variance and bias expansions in Theorem 1 match those of the 
NBB estimator for u\ (cf. [3, 9]). Hence, while both SB and NBB variance 
estimators appear structurally very different, these estimators have the same 
asymptotic performance in terms of mean squared error (MSE) as 

(4) MSE{al SB ) = ^2{2vr/(0)} 2 + ^ + o(£/n) + o(r 2 ) 

matches the expression for MSE{aJ NBB ). Theorem 1 also helps to explain 
some simulation evidence in Politis and White [16], which indicated that 
the finite sample MSE performance of the SB estimator was better than 
predicted by previous asymptotic theory. We mention that, as noted in [4], 
the matched block bootstrap estimator of a 2 , has the same first-order vari- 
ance as the NBB as well. Interestingly, the matched block bootstrap seems 
at first glance to introduce more variability through its block resampling 
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scheme (i.e., block "matching") but this aspect does not inflate this boot- 
strap estimator's variance as one might expect, much like the SB. 

The next section describes the main component in the proof of Theorem 1 . 

Remark 1. Although we focus on SB variance estimation for a real- 
valued sample mean, Theorem 1 also applies for more complicated statistics 
formed by a smooth function H(Y n ) of the sample mean Y n of a multivari- 
ate time series Y u . . . , Y n G R d , H : R d -> R (cf. [6,9]). The variance of the 
SB estimator for nVar(H(Y n )) is typically determined by variance of the 
SB estimator for cr 2 = nVar(A > n ) based on the linearly approximating se- 
ries X\, . . . , X n , with X t = H(fi) + c'{Y t — fi) & R involving the first partial 
derivatives c of H at n = ~E(Y t ) (cf. [7, 9]). 

Remark 2. We discuss the apparent difference between SB variance re- 
sults in Lahiri [9] and those presented here. The SB variance expression in [9] 
was determined by the limit of a quantity lim n ^oo J™ w e luJ g(u)/(l — qe lw ) dto 
[see Lemma 5.3(i) there], where g(u>) = 4/ 2 (w) for the case of estimating cr 2 = 
n\ai(X n ). In the proof of this limit, "— (sinw) 2 " should seemingly replace 
"(sinw) 2 " in lines (5), (8) of [9], which produces linin^oo e luJ g(to)/(l — 
qe lul ) du> = Ttg(0) — 2 _1 g(uj) duo. With this change, the proof in [9] gives 
results matching those here for the sample mean; further details can be found 
in [10] (pp. 138, 144). More generally, the results and technical arguments 
in [9] remain valid for block bootstrap estimation of bias and variance by 
changing the variances of the SB to match those provided for the NBB. 

Remark 3. Politis and Romano [15] showed that an expected block 
size of form 1°^ = Cn 1 ^ asymptotically minimizes the MSE (4) of the 
SB variance estimator and Theorem 1 yields the optimal constant as C = 
|G/{27r/(0)}| 2 / 3 assuming G / 0, f(0) > 0. This block expression also re- 
places the one in (6) of Politis and White [16] and their Section 3.2 method 
of estimating d°g B requires slight modification; their procedure would now 

produce a block estimator = (2/3) 1//3 £^Pg B using their Section 3.3 esti- 
mator of the optimal CBB block length (which follows from a relation- 
ship between these optimal blocks described in Remark 4). These changes 
in Politis and White [16] follow by correcting their Theorem 3.1 (based on 
Lahiri [9]) so that "Dsb = (3/2)Dcbb" there, which reproduces the SB 
variance as in Theorem 1. 

Remark 4. Given the SB variance, we may update a result (Lemma 3.1) 
from Politis and White [16] on the asymptotic relative efficiency (ARE) of 
SB versus CBB methods in estimating cr 2 = n Var(A > n ). In discussing ARE, 
we may also substitute "NBB" for "SB" or "MBB" for "CBB" because the 
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estimators in this pairing match in variance and optimal block size to the 
first order; all four estimators have the same bias expression as given in 
Theorem 1. Compared to the SB, the CBB estimator has a smaller asymp- 
totic variance by a factor of 2/3 (see Section 3) which produces a longer 
MSE-optimal block length as t^ BB = (6/2) 1 / 3 £° s p B by modifying (4). At each 
method's respective optimal block size, the ARE of the SB to the CBB 
estimator is given by the limiting ratio of minimized MSEs 

i D n/.2 -2 \ i. MSE ( a £°P\CBB) / 0/ o\2/3 

AKh{a eop t SB ;a eopt CBB ) = lim , 2 r- - {1/6) , 

n-oo MbH{a eaptiSB ) 

which replaces the previous bounds on this ARE given in Lemma 3.1 of [16]. 

3. A general variance result. The SB variance in Theorem 1 follows from 
a general variance result, provided in Theorem 2 below, for weighted sums 
T n of sample covariances r(k) given by 

n— 1 n—1 
(5) T n = a k , n r(k) with A n = ]T a\ n {\ - n^kf > 0, 

k=0 k=l 

based on a real- valued stationary sample X± , . . . , X n and a triangular array 
of weights {cio,n,5 • • • j O'n— i,n\ C M, ?T. ^ 1. While several authors have con- 
sidered large sample variances of certain lag weight spectral estimates (cf. 
Theorem 5.6.2/5.9.11 and page 161 references, [1]; Theorem 5A, [13]), these 
results do not readily fit the framework (3) required for the SB variance. 

Define a smoothing window as H n (u) = J2k=l °fc,n(l — n~ 1 k)e~ tkuJ and a 
nonnegative kernel K n (oj) = H n (uj)H n (—uj) / (2irA n ) , w£K. Let 

(n-l \ 2 n -l 

X! l a Ml ) n" 2 logn + n -1 ^ |afc,n|n _1 A;(l - n~ l k). 
k=l J k=l 

Theorem 2. Suppose A.1-A.2 hold and sup n maxo<fc< n _i \a,k,n\ < °°- 
T/ien; 

(i) Var(T n ) = A(2?r)2 r K n (u)f(u)dw + 0{(A n B n /n) l l 2 + J3 n ), 



(ii) lim / K n {uj)f\u)du> = f\<S) 
as n — > oo, assuming additionally for (ii) £/iaf lim^^oo^ln = oo and 

su PnEfc=2 \ a k,n ~ «fc-l,n| < OO. 

Section 4 provides a proof of Theorem 2. The factor "(1 — n~ 1 k)" is 
important in the definition of A n from (5) and nullifies weights Ofc >n at large 
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lags k in the sum. This becomes relevant in the computation of the SB 
variance as well as the CBB variance, as discussed below. 

The SB variance estimator (3) has a sum form (5) with weights aQ n = 1 
and a k ^ n = %qk,n = 2{(1 — n~ 1 k)q k + n~ 1 kq n ~ k } for k > 1 so that 

71-1 An 2 
A n = 4y2q 2k + 0(£ 2 /n) = -±- + 0(£ 2 /n), B n = O^logn/^ + n" 1 ), 

recalling 1 - q = p = £~ l and using J2 k Zi Qk,n < 2p -1 , JZfcLi ^<7 2fc ^ P~ 2 an d 
logg < —p. The terms "n _1 fcg n_fc " in </fc n can essentially be ignored in com- 
puting A n because of the factor "(1 — n~ l k)" in (5). The SB variance in 
Theorem 1 follows immediately from Theorem 2 with the block assumption 
A.3 since YJk=2 \<lk,n ~ Qk-i,n\ < 2, lining £~ x A n = 2 and B n = o(£/n). 

Theorem 2 also applies for determining the variance of other block boot- 
strap estimators that use overlapping blocks. For example, CBB, MBB and 
TBB estimators of a 2 t = nVar(A > „), based on a fixed block length £, can 
also be written as weighted sums T n of covariance estimators with weights 
oo, n = 1 and 

CBB: a k)n = 2(1 - £~ l k) for 1< k<£, a k , n = for £ < k < n - £, 

ak,n = a n - k ,k for n - £ < k < n; 

MBB: a k , n = 2(1 - £~ X k) for 1 < k < £, a k . n = 0fork>£; 

TBB: a k , n = 2v n {k)/v n (0) for 1< k < £, a Kn = for k > £, 

where TBB weights v n (k) appear in (3.6) of Kiinsch [8] (depending on a 
tapering window of bounded variation). The fact that the TBB estimator 
can be expressed as a sum (5) follows by the equivalence of the TBB and 
the tapered block jackknife estimator of a 2 (Lemma A.l, [12]) combined 
with Theorem 3.9 of [8] which expresses this jackknife estimator as a lag- 
weighted sum of sample covariances. The MBB is a special, untapered case 
of the TBB where v n (k) = £ - k, k < £. Technically, the MBB/TBB do not 
precisely use sample covariances f(k) as defined here (see (3.7), (3.8) of 
[8]) but their covariance estimators are close so that any differences have 
a negligible o(£/n) impact on the variance expansions of the MBB/TBB 
estimators. The CBB estimator o\ CBB of a 2 has a sum form (5) because 

e-i 

°Icbb = f(0) + 2 ^(1 - r l k)r ciT (k), r ciT (k) = r{k) + r(n - k) 
k=i 

using circular sample covariances f c i r (&) = n _1 JZt=i(Xt — X n )(X t + k — X n ). 

Considering the MBB, for example, it is easy to check that £~ 1 A n = <i£~ l x 
Tf k =i0--£~ 1 k) 2 + 0(£/n) ->■ 4/3 and B n = o(l/n) as n -> oo under the block 
condition A.3, in which case Theorem 2 produces the well-known variance of 
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the MBB estimator Var(df jAfBB ) = (4/3){27r/(0)} 2 ^/n + o(i/n) (cf. [7, 8]). 
For the CBB estimator cr^ CBB , ^ ms same variance expression and £~ 1 A n — ► 
4/3 both hold and, in this case, the factor "(1 — n" 1 ^)" in the definition of 
A n wipes out the effect of CBB weights afc jH , k > n — t. The variance of the 
TBB estimator can be similarly replicated with Theorem 2; see Theorem 3.3 
of [8] or Theorem 2 of [12] for this expression. 

4. Proof of Theorem 2. We require some notation in the frequency do- 
main. Let I n (u) = d n (uj)d n (—Lj)/{2irn} denote the periodogram based on 
the discrete Fourier transform d n (uj) = Y^t=i Xte~ ltuJ , u € R. Define the Fe- 
jer kernel K% (u) = (lo)H^ (-a;)/{27rn} = (2^ £? = _ n (l ~ n^e*" 
using the spectral window H^(oj) = Ya=i e~ ttuJ ,oj 6 R. Define also a function 
from Dahlhaus [5] given by 



ii . \uj\ < 1/n, 

1/n < \u\ < 7r, 



with periodic extension Lo tn (uj) = -Lo jn (2vr + u), which is helpful 

for bounding both H^(-) and the spectral window H n {-) from Theorem 2. 
Throughout the remainder, let C > denote a generic constant which does 
not depend on n or any frequencies lo,uji,lo2, A G R. We summarize some 
technical facts in the following Lemma 1. Regarding Lemma 1(h), we add 
that uniform bounds on |cu(d n (u;i), d n {u>2)) — ^H^{u}\ + tt>2)/(^i)| may 
range from o(n) when X^fcez l r (^)l < oo to 0(1) under A.l, with intermedi- 
ate possibilities; see Theorem 1 of [5]. Similarly to Theorem 5.6.2 of [1], we 
require A.l for tractability due to weak conditions on the weight forms afc >n 
in (5). 

Lemma 1. Let ui,U2 € R. Under assumption A.l for parts (ii)-(iii) be- 
low: 

(i) \H%(ui)\<CLo,n(ui) and L , n (uj) du> < Clogn. 

(ii) cu(d n (ivi),d n (uJ2)) = 2ttH^(u; 1 + a> 2 )/(wi) + Rni^i,^), \R n (^i, 
u*)\<C. 

(iii) ET=id2Ztez\r(t)r(t + d)\<C. 

Proof. Part (i) is from [5], Lemma 1. Part (ii) follows from Theo- 
rem 4.3.2 of [1] under A.l. Part (iii) follows from A.l and (1 + |t|)(l + \t + 
d\) >d for d> 1, teZ. □ 



Because sample covariances r(k) are defined with a sample mean correc- 
tion as in (3), we may assume that E Xt = holds without loss of generality. 
Then, sample covariances defined with a process mean E-Xt correction are 
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f (A;) = n" 1 *t*frffc, < k < n so that f (fc) = f (k) -n~ x X n Et=k + i X t ~ 

n^kX^. We may decompose (5) as 

n-l 

T n = Ti n + a o>n r(0) - f ln - f 2n , T ln = ^ a ktTl f(k), 

k=l 

fi n = n" 1 A n J2 n k Zl a Kn YTtZk+i x t and f 2n = n" 1 A 2 ka k>n . Note that 
Var(T n - T ln ) = 0{B n ) since Var(r(0)) = C^ra" 1 ) and Var(T in ) = O^n" 1 x 
YJk=\ l a fc,n|} 2 ) for i = 1,2 under A.l, A. 2. We aim to show 

(6) Var(T ln ) = M n + 0(B„). M - = f K n (cu)f 2 (X) dw 

n J-u 

so that Theorem 2(i) will then follow by the Cauchy-Schwarz inequality since 
/(•) is bounded by A.l and K n (-) is nonnegative with J^K n (u) dio = 1. 

We transfer to the frequency domain using that f{k) = e~ tkbJ I n {ui) duo, 
1 < k < n - 1 to rewrite T ln = J2 k Zl ak,n I- n e~ lkuj I n (u) duj and find 

n— 1 

Var(T ln ) = £ a^ n a Kn f [ e"^ ' e tk \u{I n {u),I n {X)} dXdcu 

j,k=l J-xJ-n 

(7) 

i=l j,k=l it it 

since the cumulant product theorem (Theorem 2.3.2, [1]) and E^t = entail 

3 

(27rn) 2 cu{/ n (u;),/ n (A)} = ^ 

i=l 

for gi (uj, A) = cu{d n (w),d n (-A)}cu{d„(-u;),d ri (A)}, g 2 (w, A) =gi(cj, -A) and 
g 3 (w, A) = cu{d„(w),d„(-a;) ) d rv (A), d n (-X)}. 

By A. 2 and sup fcn \a k)U \ < C, it follows that \S3 n \ = 0(l/n). We then use 
Lemma 1 to simplify the expressions for S\ n and S2n in (7). In particular, by 
applying Lemma 1(h) with the definitions of the kernel K^(-) and smoothing 
window H^(-), we may write Si n = Si n + R\ n , where 



Sin = — £ Oi,„a fc ,„ / / e-*i u e**K% (u - X)f 2 (co) dXdu 
n—X 

E ^-^(l-n-^) / e-^-^/ 2 (u;)da; 

7.1 J — 7T 



7,fc=l 

(8) 

2vr " 
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using W e %kX K^{oj — A) dX = (1 - n~ l k)e lkuj , and we apply Lemma l(i)-(ii) 
to bound the remainder 

C ( n ~ X \ 2 f n r 
\Rm\ < — E \ a k,n\) / / {L 0tn (uj-X) + l}dXdu<CB n . 
n \ k =i J J-*J-* 

A similar expansion S^n = Si n + i?2n holds where Rm = 0(B n ) and S2 n is 
defined by replacing U (J — k)" with "(j + k)" in the exponent of (8). Since 

(9) f e- ld "f(u)du = ±- J2r(t)r(t + d), deZ, 

we use a substitution j + k = d in the sum S^n and arrange terms to find 

2n-2 p 

by Lemma l(iii). Finally, from (8) we have S\ n = M n + i?3„ for M n in (6) 
and a remainder 

n 1 

n i,Jfe=l 

Using (9) with the substitution d = j — k and Lemma 1 (iii) , we bound 

r n— 1 / n—1 

n 



R3n\ < ~ E ( d + E KnK'Ml " n"^) ) E l r (*M* + d )l ^ CS n 



d=o \ k=i / tez 

using sup fcn |afe jn | < C. Hence, (6) and Theorem 2(i) are established. 

For Theorem 2(h), we use that \H n (uj)\ < CLo, n (w), uj £ R holds by 
(5)-(6) in [5] since the weights |ofc, n | are bounded and sup n J2k=2 \ a k,n — 
a>k-i,n\ < °°- Using this and that f 2 (-) is bounded with |/ 2 (0) — f 2 (u>)\ < 
C\uj\, uj S R by A.l and that K n {-) is nonnegative with K n (u)) duo = 1, 
we bound | K n (oj) x f 2 (cu) duj - / 2 (0)| by 

K n (u)\f(u) - / 2 (0)| duj < CE + CA^Ll^s) 

Uj\<£ J e<\u!\<1T 

for any < e < tt and C independent of e. Taking limits as n — > oo (i.e., 
A n — > oo, Lo, n (s) — ► and then letting e J. gives the result. 
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